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Abstract 

Large top quark flavor changing through neutral currents is expected by many extensions of 
the standard model. Direct and indirect searches for flavor changing neutral currents (FCNC) 
in the top quark decays to an up type quark (up,charm) and a Higgs boson are presented. 
We probe the observability of the top-Higgs FCNC couplings through the process e“e''‘ —>■ 
t(—>■ £veb) t(— qH), where £ = e, p and q reflects up and charm quarks. It is shown that the 
branching ratio Br{t —^ qH) can be probed down to 1.12 x 10“^ at 95% C.L. at the center- 
of-mass energy of 500 GeV with the integrated luminosity of 3000 fb“^. We also update the 
constraint on the top-Higgs FCNC coupling using the electroweak precision observables related 
to Z ^ cc decay. 


PACS Numbers: 13.66.-a, 14.65.Ha 
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1 Introduction 


The discovery of Higgs boson with a mass of about 125 GeV by the ATLAS and CMS experiments 
at the CERN-LHC [HIS]; has opened a window to search for new physics through precise mea¬ 
surements of the processes involving this particle. In particular, precise measurements of Higgs 
boson couplings to the Standard Model (SM) particles and its mass provide excellent opportu¬ 
nities for searches for the SM extensions. The Higgs boson mass and couplings to fermions and 
gauge bosons have been measured in various decay modes, and they are found to be in agreement 
with the predictions of the SM within uncertainties [3H7]. 

Top quark, the heaviest element of the SM, has the largest Yukawa coupling to the Higgs boson. 
With a mass of around 173.5 GeV, comparable to the electroweak symmetry breaking scale, 
measurement of the top quark properties would provide an appropriate probe for electroweak 
symmetry breaking mechanism. Within the SM, Higgs boson couples to fermions via Yukawa 
interactions and thereby producing the mass terms. There are no Flavor Changing Neutral Current 
(FCNC) transitions mediated by the Higgs boson or by the Z, 7 , g gauge bosons at tree level. 
In other words, no leading order transitions of t —)• qH or t —)• qV, where q reflects up or charm 
quarks and V = j,Z,g, exists in the SM framework. The SM contributions to the top quark 
FCNC occur at loop level with the expected branching ratios around 10“^^-10“^^ [ 8 j. Such FCNC 
transitions are highly suppressed due to the Glashow-Iliopoulos-Maiani (GIM) mechanism [9] and 
top quarks almost exclusively decay to a bottom quark and a W boson [I0HI2]. 

However, in some SM extensions, suppression due to the GIM mechanism can be relaxed 
because of the additional contributions of new particles in the loop diagrams and consequently 
larger branching ratios of t —)■ qH or t ^ qV are expected. Quark singlet model nain! , two 
Higgs doublet models |15H20j . the minimal supersymmetric standard model (MSSM) |21H26j . extra 
dimensions m. and natural composite Higgs models [28 p 29| are examples of the SM extensions in 
which significant enhancements of top quark FCNC appear. Fven, in type HI of two Higgs doublet 
model without flavor conservation, the t —)■ qH transitions appear at tree level. These extensions 
of the SM can enhance the branching ratio of t —)■ qH up to 10“®. Consequently, measuring any 
excess in the branching ratios for top quark FCNC processes would be an indication to physics 
beyond the SM. There are already very many studies on the probe of the FCNC processes and 
anomalous couplings in the top quark sector in the literature [8l [3nil54| . 

Searches for the existence of physics beyond the SM can be performed either at high energy 
colliders or using its indirect effects in higher order processes. In this paper, we perform direct 
and indirect probes for the top-Higgs FCNC couplings. We redo the calculations which have 
been performed in Ref. ISZj on the effects of top-Higgs FCNC couplings in the electroweak pre¬ 
cision observables of Z boson and update the upper limit on Br(t cH) using the most recent 
measurements. 

There are several proposals for a possible future e^e"*" collider [HHHHT] which would provide 
precise measurements in particular in the top quark sector and Higgs boson properties. As a 
direct way to search for the top-Higgs FCNC interactions, we study the sensitivity of a future 
e^e"*" collider via tt events at centre-of-mass energy of 500 GeV. We consider the case that one 
of the top quarks decays to a W boson and a bottom quark with leptonic decay of the W boson 
{t —>■ Hib) and the other top quark decays anomalously t —)• qH {q = u and c). We consider 
H ^ bb decay mode as the Higgs boson decay into bb pairs has maximum branching ratio [62] 
and high efficiency in tagging the jets originating from the hadronization of bottom quarks can 
be achieved [571|63l[M]. We provide the 95% C.L. upper limit on the branching ratio of t —)■ qH 
for various b-quark tagging efficiencies. There are several proposals for the center-of-mass energy 
and the integrated luminosity for a future electron-positron collider in the literature [651168] . We 
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give the results for the integrated luminosities of 300 and 3000 fb“^ of data and the center-of-mass 
energy of ^/s = 500 GeV. 

This paper is organized as follows. In Section O we briefly describe the theoretical framework 
which we consider to study the top-Higgs FCNC interactions. In Section [21 we review the current 
best limits on top-Higgs FCNC processes from direct and indirect searches. The update of the 
upper limit on Br{t —?■ cH) using electroweak precision observables of Z boson is also presented 
in Section [3l In Section [21 we describe the Monte Carlo event generation, detector simulation for 
top pair production in electron-positron collisions with FCNC decays of one of the top quarks 
{t —7- qH). The 95% C.L. upper limits on the branching ratio of t —)• qH at different integrated 
luminosities and various b-tagging efficiencies are also presented in this section. Finally, our 
summary and conclusion are given in Section [5l 


2 Theoretical framework 


The general effective Lagrangian describing the interaction of a light up type quark [q = u, c) 
with the top quark and a Higgs boson can be written as |69j : 


C 


■^-7^ ^ 9tqHq{gtgH + 9?qHl5)tH + h.C. , 

* n='ii r 


( 1 ) 


where the dimensionless real coefficient 9tqH (with q = u and c) denotes the strength of the 
top-Higgs FCNC coupling, and g is the weak coupling constant. The coefficients and gf^jj 
are general complex numbers with the normalization + \9tqH\‘^ ~ Strong cancellations 

arising from the GIM mechanism cause a tiny value for gtqu in the SM. In the SM framework, 
gtqH amounts to 10“® while in a big range of MSSM parameters space, a sizeable value at the 
order of 10“^ is expected [MIEq]. 

After neglecting the up and charm quark masses, the t —)• qH and t hW widths at leading 
order can be written as: 


r{t qH) 


a 

32 


\9tqH\^rnt 




, r{t bW) 


a\Vtb\‘^ rr4 L _ 2m^ \ 

16s^ mjj V rr4 ) ’ 


where a is the fine structure constant, Vtb is the CKM matrix element, sw is the sine of the Wein¬ 
berg angle, mt,mw and mn are the top quark, W boson, and Higgs boson masses, respectively. 
We estimate the branching ratio of t —>• qH as the ratio of r(t —>• qH) to the width of t —)• Wb. It 
has the following form; 


Br{t —)• qH) 


9tqH 


1 — 3x^ -|- 


(1-2/2)2 = 0.0274 x^2^^, 


( 2 ) 


where x = and y = rriH/mt. For the calculations, we use m/i-=125.7 GeV, mt=l73.21 

GeV, a = 1/128, and mw= 80.38 GeV [70] . 


3 Current constraints on Br{t -H qH) 

In this section, we review the currently available limits on the branching ratio of t qH from 
the collider experiments as well as the indirect limits. We also update the limits from observables 
related to Z —)■ cc decay. 
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Process 

Br Limit 

Search 

Data set 

Reference 

t 

qH 

7.9 X 10"^ 

ATLAS t —)• t —)■ Wb + qH —)• ivb + 775 

4.7,20 fb- 

@ 7,8 TeV 

m 

t —^ 

cH 

5.1 X 10"3 

ATLAS t ^ t ^ Wb + qH —)■ iub -|- 77 ^ 

4.7,20 fb' 

@ 7,8 TeV 

m 

t —y 

cH 

5.6 X 10-3 

CMS ti^Wb + qH^ Ivb + HqX 

19.5 fb' 

-3 @ 8 TeV 

m 

t —y 

qH 

5 X 10-** 

LHC tt Wb -|- qH —)■ inb + ■yyq 

300 fb- 

^ @ 14 TeV 

m 

t — y 

qH 

2 X 10-^ 

LHC tt Wb + qH ivb + 77(7 

3000 fb- 

-3 @ 14 TeV 

m 

t 

qH 

2 X 10-3 

LHC tt^Wb + qH ^ ivb + ilqX 

300 fb- 

3 @ 14 TeV 

m 

t — y 

qH 

5 X 10-^ 

LHC ti^Wb + qH ^ ivb + iiqX 

3000 fb" 

-3 @ 14 TeV 

m 


Table 1: Current direct limits as well as the projected ones on the Br(t — )• qH) at the LHC and 
future HL-LHC. 

Direct limits: The ATLAS search for the tqH FCNC is based on the top quark pair events 
with one top quark decays of t —)• qH {H —)• 77 ) and the standard decays of the other top quark. 
The analysis uses 4.7 fb“^ and 20.3 fb“^ integrated luminosity of data collected at ^/s = 7 and 
8 TeV, respectively. Assuming mn = 125.5 GeV, the observed limit on the branching ratio of 
t — )• qH at 95% C.L. is 7.9 x 10“^ [7T]. This analysis has set an upper limit of 5.1 x 10“^ at 95% 
C.L. on Br{t — cH). 

The limits from the CMS experiment is based on an inclusive search involving lepton and 
photon in the final state. The analysis uses ti events with one of the top quarks decaying to 
c + H and standard model decays of the other top quark. The results are corresponding to 19.5 
fb“^ data at the center-of-mass energy of 8 TeV. The 95% C.L. upper limit on Br{t —)• cH) has 
found to be 5.6x10“^ for a Higgs boson mass of 126 GeV [72]. Tabled] summarizes the current 
direct limits as well as the projected ones on the top-Higgs FCNC branching ratios at the LHC 
and the High Luminosity LHC with the center-of-mass energy of 14 TeV and with the integrated 
luminosities of 300 and 3000 fb“^. The LHC projections are taken from Ref. [73]. As it can be 
seen from Tabled! the best possible limit on Br(t —)• qH) from the LHC would be at the order of 
10 “^ at high luminosity regime. 

Indirect limits: Low energy measurements in flavor mixing processes can be used to constrain 
the top quark flavor violation in the tqH vertex. At loop level, mixing observable, the 

mass difference AM, receives sizeable contributions from both tuH and tcH couplings at the 
same time. Using the measured value of AM, one can obtain a limit on the product of two 
couplings, i.e. gtuHgtcH m- With the Higgs boson mass in the range of 115-170 GeV, upper 
limits of gtuHgtcH < (1.94 — 2.72) x 10“^ are obtained. This is corresponding to an upper limit of 
Br{t —)• qH) < (5.3 — 7.4) x 10“^ if we assume gtuH = gtcH- 

Another indirect way to constrain the top-Higgs FGNG couplings is to use the electroweak 
precision observables of Z bosons [37]. The tcH vertex contributes to the Z ^ cc decay at loop 
level. It affects the electroweak precision observables in Zee vertex. The total width, partial width, 
and asymmetries are affected by the tcH FGNG interaction. In [37], the tcH vertex contribution 
has been calculated and the upper limits of Br{t — )• cH) < (0.09 — 2.9) x 10“^ for the Higgs mass 
in the range of 114 < mn < 170 GeV have been obtained. We update this limit with the Higgs 
boson mass of 125 GeV using the current measurements of Zee vertex. 

After taking into account the tcH FGNG coupling contributions to the width of Z —)• cc, it 
can be written as: 


r(Z —)• cc) — T{Z^ cc)sM (1 + ) 


(3) 
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where the tcH one loop corrections are given by The details of the calculations of 

are available in m- It can be expressed in terms of the Veltman-Passarino functions. Using 
the calculations and the related inputs from the Particle Data Group m. an upper limit of 
Br{t —)• cH) < 2.1 X 10“^ is found at 95% C.L. As it can be seen, the indirect limits are at the 
same order of the current direct limits, i.e. 10“^. 

4 Study of tqH in top pair events in e“e+ collisions 

In this section, we a search for top-Higgs FCNC couplings in e“e+ t(—)• qH) channel, 

where i = e, fi and q = u,c, and present the potential of a future electron-positron collider to 
probe tqH couplings. As mentioned before, we concentrate on the semi-leptonic decay of a top 
quark and anomalous decay of another top with the Higgs boson decaying into a bb pair, as shown 
in FigiH Therefore, the final state consists of an energetic lepton (muon or electron), neutrino 
(appears as missing momentum) and four hadronic jets. Three of the jets are produced from the 
hadronization of bottom quarks. 



Figure 1: The representative Feynman diagram for production of a ti event. It includes the decay 
chain with one top decay leptonically and the other top decay from anomalous FCNC coupling 
and Higgs decay into a bb pair. 


In this study, we assume = 1 and no axial coupling, i.e. = 0. At the center-of-mass 
energy of ^/s = 500 GeV, the leading order cross section including the branching ratios reads: 

^^=500Gevi9tqH) = 11.306 X g^^jj (fb); (4) 

At higher center-of-mass energy, the cross section decreases as 1/s. Now, we turn to event gen¬ 
eration and simulation. In order to simulate the signal events, the top-Higgs FCNC effective 
Lagrangian (Eq|T]) is implemented in the FeynRules package |76It78| then the model is im¬ 
ported to a Universal FeynRules Output (UFO) module [79]. After that, it is inserted to 
MadGraph5-aMC@NL0 [80l[8T] event generator. PYTHIA |82l[^ is utilized for parton showering 
and hadronization and Delphes 3 [84[l85j is employed to account for detector effects. 
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The main background comes from top pair events with semi-leptonic decay of one of the top 
quarks and hadronic decay of another top quark. Other backgrounds to our signal include W^bbjj, 
Zbbjj (with leptonic decay of Z), and (with hadronic decay of Z). The contribution of 

^jjjj where j denotes non-bottom quark jets is studied as well. All of these backgrounds are 
generated at leading order using MadGraph5-aMC@NL0. 

To consider detector resolutions, the final state particles, leptons and jets, are smeared accord¬ 
ing to Gaussian distributions using the following parameterizations which are used in Delphes 
3. Jets energies are smeared as [581186]: 




40.0% 

W 


©2.5% (jets). 


(5) 


and for leptons (muon and electron), we use a CMS-like detector resolution: 


Et 


7.0% 0.35 , 

,_ © —— © 0.7% (leptons), 

Ee 


( 6 ) 


where Ej and Ei represent the energies of the jets and leptons, respectively. The energies are in 
GeV and the symbol © represents a quadrature sum. It should be mentioned that the electron 
and muon energy resolutions are different however, for simplicity, we smear the energies of muons 
similar to the electrons. 

The anti-ki algorithm [87| with the jet radius of 0.4 is used to reconstruct jets. We present 
the results for three b-jet identification efficiencies of 6^=60%, 70%, 80%. A mistag rate of 10% 
for charm quark jets and 1% for other light flavor jets are considered. It is notable that b-tagging 
efficiency and mistag rates play important roles in this analysis, as we have b-jets in the final state 
as well as light jets. 

The events are selected according to the following strategy. For each event, to reconstruct the 
the semi-leptonic decaying top quark, we require exactly one charged lepton with > 10 GeV 
within the pseudo-rapidity range of |7/^| < 2.5. The events with more than one charged leptons are 
discarded. The W boson momentum in the top quark decay is obtained by summing the momenta 
of the charged lepton and neutrino. Each event is required to have exactly four jets, nj = 4, with 
^ 2 q < 2.5. Among the jets, at least three jets must be b-tagged jets. The b-jet 

multiplicity is presented in Fig. [2] for signal and different SM backgrounds. As it can be seen from 
the distributions, the three b-tag jets requirement is considerably useful to reduce contributions 
of different backgrounds. 

To have well isolated objects, for any pair of objects in the final state, we require = 

■sj{r]i — rjj)"^ + {(pi — 4>j)^ > 0.4 with i and j running over all particles in the final state. 

To reconstruct the Higgs boson and then both top quarks, there are ambiguities to choose the 
correct combinations of the b-jets. To solve the ambiguities, and reconstruct the Higgs boson and 
ti system, we define a as: 


~ i^bmW ITT-top) E UTHiggs) ; (7) 

Various combinations of with m, n, and k run over the b-jets, are made and the one with 

minimum is chosen. The mass distribution of the reconstructed Higgs boson is illustrated in 
Fig. [3j As can seen the invariant mass distribution peaks at the Higgs boson mass for signal events 
while backgrounds have wide distributions. As a result, applying a mass window cut can reduce 
the backgrounds contributions. We require the reconstructed invariant mass of the Higgs boson 
to satisfy 90 GeV < ?^Hfg°gs < GeV. 
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Figure 2: Distribution of 6 -jet multiplicity for signal and SM backgrounds. 


Table [2] summarizes the cross sections (in fb) after applying the cuts for the signal and back¬ 
grounds. The b-tagging efficiency is assumed to be 60% in this table. The contribution of Zbbjj 
(with Z —>• and (with Z —)• jj) backgrounds is negiligible after all cuts. After 

the jets requirements (set II of the cuts in Table [2]), the cross section is at the order of 10“^ 
and goes to zero after the three b-jets requirement. No events of W^jjjj, where j denotes light 
flavor jets, survives after three b-jet requirement. Therefore, these sources of backgrounds are not 
mentioned in Table [2j Considering different sources of systematic uncertainties in detail is beyond 
the scope of this work so an overall uncertainty of 30% is conservatively assigned to the number 
of background events for the limit setting procedure. 


y/s = 500 GeV 

Signal 

Backgrounds 

Cuts 

(TtqH (fb) 

^W^bbjj (0^) 

<ytt (fb) 

No cut 

11.306 igtqH)’^ 

1.72 

148.70 

(I): li + \rj^\ < 2.5 + > 10 + > 10 

7.972 {gtqH? 

1.623 

106.065 

(II): 4 jets + < 2.5 -|- > 20 -|- > 0.4 

3.399 {gtqH? 

0.0071 

47.824 

(III): rib-jet > 3 -|- ARt^b-jets ^ 0.4 

0.709 {gtqH? 

0.00015 

1.417 

(IV): 90 < < 1^0 

0.570 {gtqHf 

0.00005 

0.961 


Table 2 : Cross sections (in fb) after applying different set of cuts for signal and backgrounds. 
The b-tagging efficiency is assumed to be 60% in this table. The details of the basic cuts applied, 
are presented in the text. 

Now, we proceed to set the 95% C.L. upper limit on the signal cross section. Then the limits 
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Figure 3: The reconstructed Higgs boson mass distribution from the analysis for signal and 
bakgorounds. The signal sample is generated with gtuH = 0.5. 


are translated into the upper limits on Br{t —> qH). Upper limits on the signal cross section 
is calculated with a CL^ approach [ 88 ]. The RooStats [89] program is utilized for the numerical 
evaluations of the CLs limits. 

We summarize the 95% C.L. limits on Br(t —)• qH) in Table [3] for three b-tagging efficiencies 
of 60%, 70%, 80% with 300 fb“^ and 3000 fb“^ of integrated luminosity of data. With a b-tagging 
efficiency of 70% and 300 fb“^ of data, an upper limit of 5.894 x 10“^ could be achieved. As it 
can be seen from the Table O higher b-tagging efficiency leads to improve the limits at the level 
of 30% — 40%. More amount of data makes the upper limits better however the gain is less than 
one order of magnitude. 

In comparison with the LHC direct limits presented in Table (U a future electron-positron 
collider would be able to reach similar sensitivity to the LHC experiments. The limits of the 
electron-positron collider could be signihcantly improved by including other decay modes of the 
Higgs boson such as H —)• 77 , W~^W~, and ZZ. In addition, utilizing a more powerful tool, 
such as a multivariate technique, to separate signal from backgrounds could provide better the 
sensitivity. 

5 Summary and conclusions 

In this paper, we have presented direct and indirect searches for top-Higgs FCNC couplings. The 
radiative corrections due to tcH coupling on the electroweak precision observables of Z —)• cc 
decay are used to constrain Br{t —>• cH) using the most recent measurements. This leads to the 
npper limit of 2.1 x 10“^ on Br{t cH). 
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b-tagging efficiency 

IL 

Upper limit on 

Upper limit on Br{t —)■ qH) 

eb = 60% 

300 fb"^ 

0.463 

5.894 X 10"‘^ 

€b = 60% 

3000 fb-i 

0.256 

1.798 X 10-3 

€b = 70% 

300 fb-^ 

0.373 

3.821 X 10-3 

€b = 70% 

3000 fb-i 

0.202 

1.126 X 10-3 

€b = 80% 

300 fb-^ 

0.301 

2.476 X 10-3 

€b = 80% 

3000 fb-i 

0.166 

7.546 X 10-^ 


Table 3; The 95% C.L. limits on Br{t —^ qH) for b-tagging efficiencies of 60%, 70%, 80% with 
300 and 3000 fb“^ of integrated luminosity of data. 


As a direct search, we study a future electron-positron collider potential at the center-of-mass 
energy of 500 GeV to search for the tqH FCNC couplings via top quark pair production. The 
search is based on the process in which one of the top quarks decays leptonically {t —)■ Mi'i) and 
the other top quark decays anomalously to t —)■ qH with Higgs boson decays into bb pairs. The 
95% C.L. upper limits on the branching ratio of Br{t —)■ qH) with q = u- and c-quark is found to 
be 5.894 x 10“^ for 300 fb“^ of integrated luminosity of data. This upper limit decreases down to 
1.798 X 10“^ for the 3000 fb“^ data. We find that b-tagging efficiency plays an essential role in 
this analysis and can improve the results at the level 30 — 40% moving from an efficiency of 60% 
to 70%. These limits could be considerably improved by including the other decay modes of the 
Higgs boson such as 77, W~^W~^ and ZZ. 
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